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Abstract —We study the problem of jointly sparse support re¬ 
covery with 1-bit compressive measurements in a sensor network. 
Sensors are assumed to observe sparse signals having the same 
but unknown sparse support. Each sensor quantizes its measure¬ 
ment vector element-wise to 1-blt and transmits the quantized 
observations to a fusion center. We develop a computationally 
tractable support recovery algorithm which minimizes a cost 
function defined in terms of the likelihood function and the 
^ 1,00 norm. We observe that even with noisy 1-bit measurements, 
jointly sparse support can be recovered accurately with multiple 
sensors each collecting only a small number of measurements. 

Index Terms —Compressed sensing, maximum-likelihood esti¬ 
mation, quantization, support recovery. 

I. Introduction 

Support recovery of a sparse signal deals with the problem 
of finding the locations of the non-zero elements of the 
sparse signal. This problem occurs in a wide variety of areas 
including source localization m, m, sparse approximation 
0, subset selection in linear regression lH, 0, estimation 
of frequency band locations in cognitive radio networks ||6|, 
and signal denoising 121 . In these applications, finding the 
support of the sparse signal is more important than recovering 
the complete signal itself. The problem of sparsity pattern 
recovery has been addressed by many authors in the last 
decade in different contexts. Compressive sensing (CS) has 
recently been introduced as a sparse signal acquisition scheme 
via random projections. A good amount of work has already 
been done for support recovery with real valued measurements 
0-1111. However, in practice, measurements are quantized 
before transmission or storage, therefore, it is important to 
consider quantization of compressive measurements for prac¬ 
tical purposes. Eurther, coarse quantization of measurements is 
desirable and/or even necessary in resource constrained com¬ 
munication networks. There are some recent works that have 
addressed the problem of recovering sparse signals/sparsity 
pattern based on quantized compressive measurements in 
different contexts, be it calculating performance bounds ifT^ . 
HD or devising recovery algorithms m-ini. 

However, most of the work on 1-bit CS has focused only 
on recovery for the single sensor case. Reliable recovery of a 
sparse signal based on 1-bit CS is very difficult with only one 
sensor, especially when the signal-to-noise ratio (SNR) is low. 
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On the other hand, simultaneous recovery of multiple sparse 
signals arises naturally in a number of applications including 
distributed sensor and cognitive radio networks. To the best of 
our knowledge, the problem of jointly sparse support recovery 
with multiple sensors based on 1 -bit CS has not been explored 
in the literature. In this work, we exploit the benefits of 
using multiple nodes for jointly sparse recovery with 1-bit CS 
measurements. We assume that the multiple nodes observe 
sparse signals with the same but unknown sparsity pattern. 
The measurement vectors at each node are quantized to 1-bit 
element-wise and transmitted to a fusion center. 

To recover the jointly sparse support, we propose to solve an 
optimization problem which minimizes an objective function 
expressed in terms of the likelihood function and the Zi oo 
norm of a matrix. We use a computationally tractable algo¬ 
rithm to recover the common sparsity pattern. We show that 
by employing multiple sensors, the common sparse support 
can be estimated reliably with a relatively small number of 1- 
bit CS measurements per node. In particular, we investigate the 
trade-off between the possibility of deploying multiple sensor 
nodes and the cost of sampling per node. 

II. Observation Model 

We consider a distributed network with multiple nodes that 
observe sparse signals having the same sparse support. Let 
the number of sensors be P. At a given node, consider the 
following M X 1 real valued observation vector collected via 
random projections; 

yp = $pSp-fVp (1) 

where is the M x N (M < N) measurement matrix at the 
p-th node for p = 1, • • • ,P and N is the signal dimension. 
Eor each p, the entries of are assumed to be drawn 
from a Gaussian ensemble with mean zero. The sparse signal 
vector of interest, Sp for p = I,-- - ,P, has only K{< N) 
nonzero elements with the same support. The measurement 
noise vector, Vp, at the p-th node, is assumed to be independent 
and identically distributed (i.i.d.) Gaussian with mean vector 
0 and covariance matrix ct^Im where 0 is a vector of all zeros 
and 1m is the M x M identity matrix. 

Let each element of yp be quantized to 1-bit so that the ith 
quantized measurement at the pth node is given by. 


_ / 0, if - oo < y,p < 0 
\ 1, if 0 < y,p < oo, 

where yip is the ith element of y-p, for i = 1,2, • • • , M and 
p = 1, - ■ ■ ,P. Let Z and Y be M x P matrices in which the 
(i,p)-th element of Z and Y are Zip and yip respectively, for 
p = 1, 2, • • • , P and i = 1, - ■ ■ , M. Further, let S be the NxP 
matrix which contains Sp as its columns for p = 1, 2, • • • , P. 
In matrix notation, © can be written as, 

Z = sign(Y) (3) 

where sign(Y) denotes the sign of each element of Z. 

III. Common Support Recovery with 1-bit CS 
Measurements via Zi-Regularized Maximum 
Likelihood 

In this section, first we formulate an optimization problem 
for joint sparsity pattern recovery for 1-bit CS. We use the 
regularized li norm minimization approach with the likelihood 
function as the cost function instead of the widely used least 
squares function. With quantized measurements, the approach 
which uses the likelihood function as the cost function has 
been shown to provide better results compared to least squares 
methods with a single sensor M- 

For the sake of tractability, we assume that the measurement 
matrix $p = ^ is the same for all p = 1, 2, • • • , We have 
from ©, 


yip — ^i Sp -f Vipj (4) 

for i = 1, 2, • • • , M and p = 1, 2, • • • , P. In the rest of the 
paper, denotes the i-th row of $. 

Next, we calculate probabilities Pr{zip = 1) and Pi^Zip = 
0) which will later be used to write the expression for the 
likelihood of Z given S. We have, 

Pr(2/ip > 0) ^ Pr(^f Sp -f Vip > 0) = Sp/ay). 

Similarly, 

Pr{yip < 0) ^ Pii^fsp+Vip < 0) = Sp/ay). 

where = (l/-\/^) The conditional prob- 

ability of Z given S is given by, 

P M 

pr(zis)=nnp^(^ 

p—l i—l 


.IS) 




The negative log-likelihood of Z given S, /m;($S), is given 


by 


p M r / / T T 

-EeL 

p=l i=l 

which can be rewritten as 


+ (1 - Zip) log 




P m 


fml{X) = -EE 

p—1 i—l 


. log U- 


Xir 


+ {1- Zip) log 


'^ip 


(5) 


and X = $S. In the following, we use X and $S interchange¬ 
ably. We need to minimize this expression, /mi(^S), as well 
as incorporate the sparsity condition of the signal matrix S 
to obtain an estimated signal matrix S or the support of S. 
As all the signals observed at all the nodes have the same 
support, the row-Zo norm (as defined in lITSll for real valued 
measurements) is appropriate to incorporate the joint sparsity 
constraint. The row-/o norm of S is given by, 

||S||ro™-o = |rowsupp(S)|, 

which is also referred to as the Zq.oo norm, where the row 
support of the coefficient matrix S is defined as m 
rowsupp(S) = {w G [l,iV] : Swk ^ 0 for some k}. 

Now to compute S, one can solve the following optimization 
problem: 


argmin + A||S|| 

0,oo } 

S 


(6) 


where A is the penalty parameter. However, the problem (|6]) 
is not tractable in its current form and can be relaxed as 

argmin {/mi(4*S) + A||S||i,oo} (7) 

s 

where ||S||i_(x) = max js^j, i.e., ||S||i_oo is the sum 

i<j<p 

of all the elements with maximum absolute value in each row, 
also known as the li ^o norm of a matrix. 

The goal is to develop a computationally tractable algorithm 
to solve the problem of the form 

argmin {/(4>S) -f Ap(S)} (8) 

s 

where /(4*S) = fmii^S) and g{S) is the Zi oo norm of S. 

We use iterative shrinkage-thresholding algorithms (ISTA) 
for solving the problem defined in ®. In ISTA, each iteration 
involves solving a simplified optimization problem, which in 
most of the cases can be easily solved using the proximal 
gradient method, followed by a shrinkage/soft-threshold step; 
for e.g., see llT^ - ll2l1l . From IItTII . at the k-th iteration we have 
Sk=PLfiSk-i) (9) 

where 

Pl^{T) = argmin Ap(S) + E||s - (T - Ev/(T)|||. 

( 10 ) 

Inputs to the algorithm are L j (the Lipshitz constant of V/) 
and So, the initialization for the iterative method, which can 
be kept null matrix or $lZ, where $1 is the pseudoinverse 
of $ and Z is the quantized received signal matrix as defined 
before. For our case, the gradient of /mi(X) w.r.t. matrix S 
can be easily calculated as $^V/m;(X), where X = $S. 
Notice that, V/m;(X) is the gradient of /m;(X) w.r.t. X and 
is given by 


’The work can easily be extended to the scenario having different mea¬ 
surement matrices. 


^ fml iy^ip) 


Zipexp(-^) 

(Jytjt^Xip) 


(1 - Zip)exp(-%^) 
(Jytjti^ Xip) 


( 11 ) 













where Xip = Xipja^. 

The problem defined in (fTOl i is row separable for each 
iteration. Therefore, to solve for S^, i.e., to find Pi(Sfc_i), 
we divide the problem into N subproblems, where N is the 
number of rows in S. Next, we solve the following subproblem 
for each row of S^: 

argmin Ap(s*) + - (t* - ^V/(t»))||2; (12) 

si I Lf 

where s*, t* and V/(t*) are the rows of S, Sfc_i and 
V/(Sfc_i) respectively. Equation (fT^ is of the form: 

argmin |a 5 (s) + ^||s - u||^| ; (13) 

where g{s) = ||s®||oo, i-e., the loo norm of the row of S 
and constant vector u is given by u = t® — ■j^V/(t*) (we do 
not use superscript i on g{s) and u for brevity). 

For O, we have the following equivalent problem in the 
epigraph form 

s - UII 2 I, s.t. 0 < sgn(up)sp < t, (14) 

where A = ■^, Up and Sp are the p-th elements in u and s 
respectively, for all p = 1, 2, • • • ,P and f S R. Define Wp = 
sgn(up). The problem in (fT4l) can be solved using Lagrangian 
based methods. The Lagrangian for (fl4l i is 

Z/(s, cr,/il) — Af-t-“||s u||/3p('u:pSp f) ^ ^ O-pWpSp 

p p 

with dual variables a = [ai,--- ,Q;p]^ and /? = 

[/3i, • • • 

Hence, for strong duality to hold, following Karush-Kuhn- 
Tucker (KKT) conditions must be satisfied by the optimal 


s*,t*,a* and /3*. 

(s; - Up) - a;wp +/3;wp = 0, (15) 

P 

a;(wps;)=0, (17) 

/3;(wps;-t*) = o, ( 18 ) 

a;,/3;>0. (19) 


Note that 0 < WpSp < t, p = 1,..., P. To find the optimal 
s*, consider three simple cases 

Case (i): 

WpS* = 0 

=> /3p = 0 (from (fT^ ) 

=> Up + a*Wp = 0 (from O) 

_ qi 

=> ct* = - - which is < 0. 

^ Wp 

Therefore, from (fT9l l. s* = 0 if and only if Up = 0. 

Case (ii): 

0 < WpSp < t 

=> /3p = 0 (from (fTSl l) and a* = 0 (from (fTTl i) 

=> Sp = Up (from O) 


arg mm 


- 1 
Af + - 


Case (Hi): 


WpSp = t 

=> Sp — Up + jdpWp = 0 (from (fTSl l) 
t* 

Up “t“ f3p Wp — 0 

Wp 


^ Wp w^ 

6p = \up 


- 1 *. 


Also, since /3p > 0 V p = [1, 2, • • • , P], we have jS* 
t*)+, where (x)+ is defined as max(x, 0). 

Using (flbl l in the above equation, we have 

V(|up|-P)+-A = 0 


(|wp|- 

( 20 ) 


as /3p = (lupl - t*)+. This can be easily solved for t* by 
applying the bisection based method using the initial interval 
[0, ||u||oo]- Define 

g{t) = '^{\up\ - t*)+ - X. 

p 

Therefore, g{t*) = 0. If there exists no solution in the interval 
[0,||u||oo], i-e., p(0) X p(||u||oo) > 0, the trivial solution is 
given by t* = 0. Once we have the optimal t*, the optimal s* 
is given by 

q* = / if |up| > f ; 

^ \ Up otherwise. ^ 


Each subproblem given by (fT2li can be solved in a similar 
way, the solution to each of which can be used to find 
using (|9]l and (fTOl i. The summary of all the steps is provided 
in Algorithm [T] where ||.||p denotes the Frobenius norm. 
Algorithm [T] produces the matrix and locations of non-zero 

elements in Sfc gives the support of original signal matrix S. 


Algorithm 1 Estimation of the common support of the sparse 
signal 

1) Given tolerance e>0, parameters A>A, 0<q;< 1 and Lf 

2) Initialize Sp (S_i = Sp), A = A, k = 0 

3) While A > A 

4) A = aA 

5) While ||Sfc - Sk-i\\F > e||Sfe_i||F 

6) k = k + 1 

7) Define matrix U = Sk-i — -j^V/(Sfc_i) where 
V/(Sfe_i) is computed as in (fTTI) 

8) For each row of 

9) Update the p-th row element using (EB for p = 

,P 

10) End For 

11) End While 

12) End While 


IV. Numerical Results 

In this section, we present some simulation results to 
demonstrate the performance of jointly sparse support recovery 
with 1-bit CS based on our proposed algorithm. For every 
Monte Carlo run, we generate the elements of the M x N 
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Fig. 2. Performance of common sparsity pattern recovery when cr^ = 0.0001 


measurement matrix $ from a normal distribution with mean 
zero and variance = 0.004. In all our simulations, we used 
randomly generated sparse signal matrix S, with each column 
size fixed as N = 100. We choose K random values out of N, 
which are the nonzero rows in S. Eor each column of S, all 
the elements whose position is given by the K random values 
are assigned a value of either 1 or —1 with probability 0.5. 
The value of K is kept 5. The observation noise is assumed 
to be Gaussian with mean zero and variance is = 0.01 
(SNR = 2.96 dB, low SNR case), and = 0.0001 (SNR 
= 23.01 dB, high SNR case). We measure the percentage of 
support recovered correctly and the probability of recovering 
exact support as M, P and SNR vary using 1000 Monte Carlo 
runs. 

Our results for low SNR regime are plotted in Eig. [T] 
The y-axis shows the number of sensors (P) and the x-axis 
shows the number of measurements per node (M). In Eig. 
[U (a), the numbers on contours represent the percentage of 
support that are recovered. Similarly, in Eig.ITJb), the numbers 
on contours represent the probability of recovering the exact 


support. We can deduce that for a particular value of M, the 
performance improves with the number of sensors, and vice- 
versa. Similarly, Eig. |2] shows the contour plots in the high 
SNR regime. We see that even with a very small number of 
sensors, for e.g., P = 3, the algorithm performs very well for 
reasonable values for M, such as M = 60. 

In Eig. [3 we compare our results with one of the most 
related algorithms for sparse recovery with quantized measure¬ 
ments as provided in lITSll . which uses the ML method for only 
one node (one measurement vector). To compute the common 
support with P measurement vectors, the individual support 
sets were computed for each signal using the algorithm in ifTsll . 
and the estimated support sets were fused using the majority 
rule. Eor comparison, values of M, N and K were chosen 
as 50, 100 and 5, respectively. The observation noise variance 
= 0.0001. As seen from Eig. [2 our proposed approach for 
joint sparsity pattern recovery with quantized measurements 
outperforms the case when the support is estimated individ¬ 
ually as in Qa and then fused. In particular, the proposed 
algorithm in this paper exploits the jointly sparse nature of 
























(a) Percentage Support Recovery (b) Probability of Estimating Exact Support 


Fig. 3. Comparison of our results with the approach presented in (SI: M = 50, N = 100 and K = b, in terms of the percentage of support recovered 
con'ectly and the probability of recovering exact support 


multiple measurement vectors thus outperforming the results 
obtained by estimating the supports individually using M 
and then fused. 

V. Conclusion 

In this paper, we exploited the use of multiple sensors for 
the recovery of common sparsity pattern of sparse signals with 
1-bit CS. A computationally tractable algorithm was developed 
to optimize an objective function defined in terms of likelihood 
function and the li,oo norm of a matrix. Numerical results 
show that, with very coarsely quantized measurements (only 
the sign information), the common sparsity pattern of sparse 
signals can be recovered reliably even in the low SNR region, 
and the performance increases monotonic ally with the number 
of sensors. 
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